The Default Library · Mathematics 14 of 20 · 3 min read

Vectors and Matrices: The Geometry of Linear Transformations

Linear Algebra is not a dry grid of numbers; it is the visual geometry of transforming space—powering 3D video games, Pixar animation, and AI neural networks.

Why is Linear Algebra the most widely applied branch of modern mathematics? Because every 3D video game engine, every Pixar animated film, every quantum physics calculation, and every AI neural network runs on vectors and matrices. Rather than thinking of a matrix as a boring spreadsheet of numbers, the visual way to understand a matrix is as a recipe for transforming space itself.

Interactive 2D Space Transformer
A 2×2 matrix moves every point of the plane. Watch the two basis arrows: î (orange) starts at (1, 0) and ĵ (blue) at (0, 1). Wherever they land is the whole recipe. Pick a preset or set the four numbers yourself.
îĵ

Figure: the shear matrix 1101. î stays at (1, 0) while ĵ is pushed over to (1, 1), so the grid leans sideways. The shaded unit square becomes a parallelogram with the same area (determinant 1). The dashed line is the one direction the shear leaves pointing the same way — its eigenvector, along the x-axis, with eigenvalue 1.

Vectors as Arrows vs. Points

In physics, a vector is an arrow with a direction and length (like velocity or force). In computer science and AI, a vector is an ordered list of numbers representing a point in multi-dimensional space (e.g., a pixel color, a user preference vector, or a word embedding in a Large Language Model).

Matrices as Recipes for Transforming Space

A 2×2 matrix abcd is simply a compact way of recording where the two fundamental basis vectors land after space is stretched, rotated, or sheared:

Once you know where î and ĵ land, you know where every single point in space lands after the transformation!

Eigenvalues and Eigenvectors: The Unshakable Axes

When you transform space (by stretching or shearing it), most vectors get rotated into new directions. However, a few special vectors stay on their exact same line of direction—they simply get stretched or squished! These special vectors are called Eigenvectors, and the factor by which they stretch is their Eigenvalue (written λ).

Eigenvectors reveal the underlying axes of a transformation—used in Google's PageRank algorithm, facial recognition, structural engineering, and quantum state analysis.

Quick check: where does it land?

1. A matrix sends î to (2, 0) and ĵ to (0, 3). Where does the point (1, 1) go?

  • (1, 1) — it doesn't move
  • (2, 3)
  • (3, 2)

Answer: (2, 3). The point (1, 1) is one î plus one ĵ, so it lands at (2, 0) + (0, 3).

2. The matrix with columns (0, 1) and (−1, 0) rotates the plane 90° counter-clockwise. Where does î = (1, 0) end up?

  • (0, 1), pointing straight up
  • (−1, 0), pointing left
  • (1, 0), unchanged

Answer: (0, 1). The first column is literally where î lands — no arithmetic needed.

3. A matrix has determinant 0. What has it done to the plane?

  • Doubled every area
  • Rotated it without changing areas
  • Squashed it flat onto a line (or a point), so it can't be undone

Answer: squashed flat. The determinant is the factor by which areas scale; zero area means the plane collapsed, and no matrix can un-collapse it. Try the “Flatten” preset above.

Takeaways

Linear algebra is the visual study of linear transformations. A vector represents direction and magnitude in space, while a matrix records where basis vectors land when space is rotated, stretched, or sheared. Eigenvectors represent the special lines that maintain their original orientation during a transformation, providing the mathematical backbone for computer graphics and AI machine learning.

Action step: Tap the "Shear" and "Rotate 90°" presets above and notice how the landing spots of î (orange) and ĵ (blue) are exactly the two columns of the matrix.

Sources: Grant Sanderson's Essence of Linear Algebra (3Blue1Brown). Gilbert Strang's Introduction to Linear Algebra.

Go Deeper:
📘 Introduction to Linear Algebra — Gilbert Strang (MIT's legendary linear algebra textbook)
🌐 3Blue1Brown — Essence of Linear Algebra Video Series